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(57) Method for speech signal synthesis by means 
of time concatenation of waveforms representing ele- 
mentary units of speech signal, in which: at least the 
waveforms associated to voiced sounds are subdivided 
into a plurality of intervals, corresponding to the 
responses of the vocal duct to a series of excitation 
impulses of the vocal cords, synchronous with the fun- 
damental frequency of the signal; each interval is sub- 
jected to a weighting; the signals resulting from the 
weighting are replaced with a replica thereof shifted in 
time by an amount that depends on a prosodic informa- 
tion; and the synthesis is carried out by overlapping and 
adding the shifted signals. In each inten^al of original sig- 
nal to be reproduced in synthesis, an unchanging part is 
identified, which contains the fundamental information 
and which is reproduced unaltered in the synthesized 
signal, and the operations of weighting, overlapping and 
adding involve only the remaining part of the interval. 
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Description 

The invention desaibed herein relates to speech synthesis and more particularly to a synthesis method based on 
the concatenation of waveforms related to elementary speech units. Preferably, but not exclusively, the method is applied 

5 to text-to-speech synthesis. 

In these applications, a text to be transformed into a speech signal Is first converted into a phonetic-prosodic rep- 
resentation, which indicates the sequence of corresponding phonemes and the prosodic characteristics (duration, inten- 
sity, and fundamental period) associated to them. This representation is then converted into a digital synthetic speech 
signal starting from a vocak)ulary of said elementary units, which in the most common case are constituted of diphones 

10 (voice elements extending from the stationary part of a phoneme to tiie stationary part of the subsequent phoneme, tiie 
transition between phonemes included). For the Italian language, a vocabulary of about one thousand diphones ensures 
the phonetic coverage, allowing all admissible sounds for Italian language to be synthesized. 

In systems for text-to-speech synthesis, methods based on the concatenation, in the time domain, of the waveforn^ 
representing the various elementary units can be used for tiie generation of tiie speech signal: these methods are very 

15 flexible and guarantee good syntiietic speech quality. 

An example is described by E. Moulines and F. Charpentier in the paper Titch-synchronous waveform processing 
techniques for text-to-speech synthesis using diphones". ^eech Communication. Vol. 9. No. 5/6. December 1 990, pages 
453-467. This method is based on tiie technique known as PSOLA (Pitch-Synchronous Overlap and Add), to apply the 
prosody imposed by the synthesis rules and concatenate tiie wave-forms of tiie elementary units. At least for tiie voiced 

20 segments of the original signal, the PSOLA technique carries out an analysis by applying a pitch-synchronous windo- 
wing, in particular by using Manning windows whose duration is roughly twice tiie fundamental period (pitch period), 
thereby generating a sequence of partially overlapping short-term signals; in the syntiiesis phase, the signals resulting 
from the windowing are shifted in time synchronously with the fundamental period imposed by tiie prosodic rules for 
synttiesis;f inally. the synthetic signal is generated by overlapping and adding tiie shifted signals. To reduce computational 

25 complexity, the second step can be carried out directiy in the time domain. 

The complete windowing of the individual intervals of the original signal requires a relatively heavy computational 
load and moreover it constitutes an alteration of the original signal extending over the entire interval, so tiiat tiie synthetic 
signal sounds less natural. 

According to tiie invention, a synthesis method is provided in which that part of each interval of tiie original signal 
30 which contains the fundamental information is left unchanged, and only tiie remaining part of the interval is altered: this 
way. not only processing time is reduced, but the natural sounding of the synthetic signal is also improved, since the 
main part of the interval is the exact reproduction of tiie original signal. 

The invention therefore provides a method for the speech signal synthesis by means of time-concatenation of wave- 
forms representing elementary speech signal units, in which: at least tiie waveforms associated to voiced sounds are 
35 divided into a plurality of intervals, corresponding to the responses of the vocal duct to a series of impulses exciting the 
vocal cords synchronously with tiie fundamental frequency of the signal; the waveform in each interval is weighted; the 
signals resulting from the weighting are replaced witti a replica thereof, shifted in time by an amount depending on a 
prosodic information; and the synthesis is carried out by overlapping and adding tiie shifted signals; and in which: 

40 - a current interval of original signal to be reproduced in syntiiesis is subdivided into an unchanging part, which lies 
between the interval beginning and a left analysis edge represented by a zero crossing of the original speech signal 
that meets pre-determined conditions, and a changeable part, which lies between the left analysis edge and a right 
analysis edge essentially coinciding with the end of tiie current interval, tiie left and right analysis edges being 
associated, in tiie syntiiesized signal, respectively with a left and a right synthesis edge, of which tiie former coincides 

45 with the left analysis edge, witii reference to a start-of-interval marker, and tiie latter coinckles essentially witti the 
end of tiie interval in the synthesized signal; 

- a first connecting function, which has a duration equal to that of tiie segment of synthesized waveform lying between 
the left and right syntiiesis edges and an amplitude which decreases progressively and is maximum in correspond- 
ence with tiie left analysis edge, is applied on the part of waveform on tiie right of tiie left analysis edge of the cunent 

50 interval of original signal; 

- a second connecting function, which has a duration equal to ttiat of tiie segment of synthesized waveform lying 
between tiie left and right syntiiesis edges and an amplitude which inaeases progressively and is maximum in 
conespondence with the beginning of said sutsequent interval, is applied on the part of waveform on the left of the 
subsequent interval of original signal to be reproduced synthetically; 

55 - each interval of synthesized signal is built by reproducing unchanged tiie waveform in tiie unchanging'part of tiie 
original interval and by joining thereto tiie waveform obtained by aligning in time and adding tiie two waveforms 
resulting from the application of tiie first and second connecting functions. 
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For the sake of further clarification, reference is made to the enclosed drawings, which illustrate an embodiment of 
the invention given by way of non-limiting example and where: 

Figure 1 is the general outline of the operations of a text-to-speech synthesis system through concatenation of 
5 elementary acoustic units; 

- Figure 2 is a diagram of the synthesis method through concatenation of diphones and modification of the prosodic 
parameters in the time domain, according to the invention; 

- Figure 3 represents the waveform of a real diphone, with the markers for the phonetic and diphone borders and 
the pitch markers; 

10 - Figures 4, 5 and 6 are graphs representing how the prosodic parameters of a natural speech signal are modified 
in some particular cases, according to the invention; 

- Figures 7A. 7B. 8A. 8B. 9A. 9B. 10A and 108 are some real examples of application of the method according to 
the invention for the modification of the fundamental period on segments of the diphone in Figure 3; 

- Figures 11 - 18 are flow charts of the operations for determining the left analysis and synttiesis edge. 

IS 

Before describing the invention in detail, the structure of a text-to-speech symhesis system is briefly described. 
As can be seen in Figure 1 . as a first phase tiie written text is fed to a linguistic processing stage TL which transforms 
the written text into a pronounceable form and adds linguistic markings: transcription of abbreviations, numbers, .... 
application of stress and grammatical classification rules, access to lexical information contained in a special vocabulary 

20 VL The sut}sequent stage, IF, candies out the transcription from orthographic sequence to the corresponding string of 
phonetic symbols. On the basis of a set of prosodic rules RP. the prosodic processing stage TP provides duration and 
fundamental period (and tiius also fundamental frequency) for each of the phonemes leaving TF This information is 
then provided to tiie pre-synthesis stage PS. which determines for each phoneme, the sequence of acoustic signals 
forming the phoneme (access to diphone data base VD) and, for each segment, how many and which intervals, witii 

25 duration equal to the fundamental period, are to be used (in the case of voiced sounds) and the corresponding values 
of the fundamental period to be attributed in syntiiesis. These values are obtained by interpolating tiie values assigned 
in correspondence with tiie phoneme borders. In the case of unvoiced or "surd" sounds, in which there are no periodicity 
characteristics, the intervals have a fixed duration. This information is finally used by tiie actual synthesizer SINT which 
performs the transformations required to generate tiie syntiietic signal. 

30 Figure 2 illustrates in greater detail the operation of modules PS and SINT The input is constituted by the cun^ent 
phoneme identifier Fj, by tiie phoneme duration Dj and by tiie values of the fundamental period P\.^ at tiie beginning of 
the phoneme and Pj at tiie end of the phoneme, and by the identifiers of tiie previous phoneme Fj.^ and of tiie subsequent 
one Fj^i. The first operation to be performed is to decode diphones DFj.^ and DFj and to detect the markers of diphone 
beginning and end and of phoneme border. This information is drawn directiy from tiie data base or vocabulary storing 

35 diphones as waveforms and the related border. voicedAjnvoiced decision and pitch marking descriptors. The subsequent 
module transforms said descriptors taking the phoneme as a reference. On the basis of this information, a rhythmic 
module computes the ratio between duration Dj imposed by the rule and the intrinsic duration of tiie phoneme (memorized 
in tiie vocabulary and given by the sum of the two portions of the phoneme belonging to the two diphones DF|.i and 
DFj). Then, taking into account tiie modification of tiie duration, it computes tiie number of intervals to be used in synthesis 

40 and determines the value of the fundamental period for each of them, by means of a law of interpolation between value 
Pj.^ and Pj. The value of tiie fundamental period is tiien actually used only for voiced sounds, while for unvoiced sounds, 
as stated above, intervals are considered to be of fixed duration. 

For the actual synthesis, the operations are different depending on whether the sound is voiced or unvoiced. 
In the case of unvoiced sound, the syntiiesis demands a simple time shift (lengthening or shortening) of the aforesaid 

45 intervals on the basis of the ratio between tiie duration imposed by tiie prosodic rules and the intrinsic duration. In tiie 
case of voiced sound, instead, the method according to the invention is applied. 

The synthesis method according to the invention starts from the consideration that a voiced sound can be considered 
as a sequence of quasi-periodic intervals, each defined by a value Pa of the fundamental period. This is clearly seen in 
Figure 3, which shows the waveform of diphone "d_m**, the related markers separating individual intervals and, for each 

so interval, value Pa of tiie corresponding period expressed in Hz. The part of Figure 3 between the two markers "v" cor- 
responds to tiie right portion of phoneme "d"; the part between tiie second marker V and the end-of-diphone marker 
T corresponds to tiie left part of phoneme **m". The aforesaid intervals may be considered as the impulse responses 
of a filter, stationary for some milliseconds and corresponding to the vocal duct, which is excited by a sequence of 
impulses synchronous with tiie fundamental frequency of the source (vibrating frequency of tiie vocal cords). For each 

55 interval tiie synthesis module is to receive the original signal with fundamental period pa (analysis period) and to provide 
a signal modified with period Pa (synthesis period) required by prosodic rules. 

The essential information characterizing each speech interval is contained in the signal part immediately following 
the excitation impulse (main part of tiie response), while tiie response itself becomes less and less significant as the 
distance from tiie impulse position increases. Taking this into account, in the synthesis method according to tiie invention 
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this main part is maintained as unchanged as possible and the lengthening or shortening of the period required by the 
prosodic rules are obtained by acting on the remaining part. 

For this purpose, an unchanging and a changeable part are then identified in each Interval, and only the latter is 
involved in connection, overlap and add operations. The unchanging part of the original signal is not constant, but rather 

5 it depends for each interval on the ratio between pg and pa- TTiis unchanging part lies between the start-of-interval marker 
and a so-called left analysis edge bga. which is one of the zero crossings of the original speech signal, identified with 
criteria that will be desaibed further on and that can be different depending on whether the synthesis period is longer, 
shorter or equal to the analysis period. The changeable part is delimited by the left analysis edge and by a so-called 
right analysis edge b^a. which essentially coincides with the end of the interval, in particular with the sample preceding 

10 the start-of-interval marker of the subsequent interval. 

In the synthesized signal, a left and a right synthesis edge bga. bda will con-espond to the left and right analysis edge 
bsa. bda For a given interval, the left synthesis edge obviously coinddes with the left analysis edge, with reference to 
the start-of-interval marker, since the preceding part of signal is reproduced unaltered in the synthesis. The right syn- 
thesis edge is defined by relation 

IS 

bd8 = bss + Ap (1) 

where Ap = p^ - p ^ will have a positive or negative value depending on whether, in synthesis, there is a lengthening or 
shortening of tfie fundamental period. 

20 The changeable part of the interval is modified by applying a pair of connecting functions whose duration is 
As = bfjs - bs3 . The first function has a maximum value (specifically 1) in correspondence witii tiie left analysis edge 
and a minimum value (specifically 0) in correspondence with the point baa + As. The second function has a maximum 
value (specifically 1) in con-espondence witii tiie right analysis edge bd a and a minimum value (specifically 0) in con-e- 
spondence with point b^a - As. The connecting functions can be of ttie kind commonly used for ttiese purposes (e.g. 

25 Manning windows or similar functions). 

For the sake of further clarifying the invention, Figures 4 - 6 show some graphs illustrating tiie application of the 
method to a fictitious signal. In these Figures, part A shows three consecutive intervals of the original signal, with indexes 
i-1 , i. i+l , and indicates also their fundamental periods p ah = • ^'*'^) Pi^^ start-of-interval) markers 

Ma and tiie left and right analysis edges bga. b^a- Parts B and C show, for each interval, respectively tiie first and second 

30 connecting functions (which hereinafter shall be called for the sake of simplicity "function B" and "function C") and the 
time relations with the original signal. Part D shows the synthesized signal waveforms resulting from the mettiod accord- 
ing to tiie invention, with tiie indication of the respective fundamental periods p^ (k = j-1 , j, j+1) . of pitch markers Ms 
and of left and right syntiiesis edges b^s. b^s- P^^^ ^ \sa representation of the waveform portion where, after tiie time 
shift, the waveforms obtained witii tiie application of the two connecting functions to flie changeable part of tiie original 

35 signal are submitted to the overlapping and adding process. Note fliat tiie serial numbers of tiie intervals in analysis and 
synthesis can be different, since suppressions or duplications of intervals may have occurred previously 

In particular. Figure 4 illustrates the case of an increase in fundamental period (and therefore decrease in frequency) 
in synthesis with respect to tiie original signal, in a signal portion where no interval suppressions or duplications have 
occurred. Weighting is carried out in each interval witii a respective pair of connecting functions. As a consequence of 

40 the period inaease, duration As of tiie functions is greater tiian the length of the variable part of the original signal, so 
that function B also interests the beginning of the waveform related to the subsequent interval, while function C interests 
a part of waveform on the left of the left analysis edge. 

Figure 5 shows an analogous representation in the case of decrease in fundamental period (and therefore increase 
in frequency) in synthesis with respect to the original signal. In tiiis example too no interval suppressions or duplications 

45 occurred. In this case functions B. C interest a waveform portion with shorter duration than the portion lying between 

baa *^da- 

Finally, Figure 6 shows an example of increase in fundamental period in synthesis in the case of suppression of an 
interval of tiie original signal (tiie one with index i in the example). Two intervals are obtained in synthesis, indicated by 
indexes j-1 and j, which intervals respectively maintain, as unctianging part, the one of intervals with index i-1 and i+1 

50 in the original signal. The interval with index i+1 in the original signal is processed in the same way as each interval of 
original signal in Figure 4. The nrKxJified part of the interval with index j-1 in the synthesized signal, instead, is obtained 
by overlapping and adding the two waveforms obtained by weighting only with function B the changeable part of the 
interval with index i-1 in the original signal, and by weighting only witii function C the final part of tiie interval with index 
i in the original signal. In other words, function B is applied on the right of bga in the current interval to be reproduced in 

55 synthesis, and function C is applied on tiie left of the subsequent interval to be reproduced. These procedures of appli- 
cation of the connecting functions are quite general and are applied also in case of interval duplication and diphone 
change. 

Purely by way of example, for the diagrams in figures 4 - 6 the following functions were utilized: 
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0.5 - 0.5 cos{K[(As-1+bs8-x,)/(As-1)] "} (function B) 

5 0.5 - 0,5-cos{7iI(X|-bs8)/(As-1)] "} (function C) 

In these functions, b^g, As have the meaning seen previously and are expressed as a number of samples; Xj is 
the generic sample of the variable part of the original waveform (with b3a^X|<b3a + As, for function B. and 
b^ - As s X, < b^a forfunctionC);nisanumt>erwhichcanvary(ag.from1to3)dependingonratioAs/Pa:inparti^ 
10 in the drawing, n was considered to be 1 . Ok)viously, in the formulas, value 0.5 can be replaced by a generic value PJ2 
if a function whose maximum is A instead of 1 is used, or by a pair of values whose sum is 1 (or A). 

Figures 7A, 7B to 1 0A. 1 0B represent some real examples of application of the method, for two portions of diphone 
"^_m" of Figure 3, utilized in two different positions in the sentence where the synthesis rules require respectively a 
decrease and an increase in fundamental period (and therefore an increase and respectively a decrease in fundamental 
IS frequency). For all intervals, pitch markers, left analysis and synthesis edges and fundamental frequency, both in analysis 
and synthesis, are indicated. Figures with letter A show the original waveform and Figures with letter B the synthesized 
signal. Figures 7A. 7B. dA, 8B show the first two intervals of the diphone being examined (phoneme "^") in case of 
increase (Figures 7A. 7B) and respectively of decrease (Figures 8A, 8B) of the fundamental frequency. Figures 9A. 9B. 
10A, 10B show instead the first two intervals of phoneme "m" in the same conditions as illustrated in Rgures 7. 8. As 
20 an effect of the frequency decrease, only the first interval is completely visible in Figures 8B and 1 0B. 

A preferred embodiment of the method adopted to identify the left analysis and synthesis edge for each interval to 
be reproduced in synthesis will now be described. In the example described, a different method is used depending on 
whether the fundamental period in synthesis is smaller than or equal to the period in analysis, or it is greater. 
Figure 1 1 is the general flow chart of the operations can-ied out if p^ ^ pa- 
2S The first operation is the computation of function ZCR (Zero Crossing Rate) indicating the number of zero crossings 
(step 1 1). In this confutation, zero crossings that are spaced apart from the previous one by less than a limited number 
of signal samples (e.g. 10) are neglected, in order to eliminate non-significant oscillations of the signal. 

As can be seen in Figure 13. the zero aossings that are considered are assigned an index varying from 1 to the 
descriptor of the total zero crossing number LZV (step 110). Moreover, the following variables are assigned (step 111): 

30 

- bda (right analysis edge) to the value of analysis period Pai 

- (right synthesis edge) to the value of synthesis period b^a + Ap; 

Diff_a_s to the absolute value |Ap| of the difference between the analysis and synthesis periods. 

35 In these relations, as in those examined further on. the values of the periods and the lengths of certain intervals are 
expressed in terms of number of samples. 

Going back to Figure 1 1 , after computing function ZCR. a check is made (step 1 2) that the number of zero aossings 
found in step 1 1 is not lower than a minimal threshold of zero crossings IndZ.Min (e.g. 5 crossings). Actually, according 
to the invention, it is desired to reproduce unaltered, in the synthesized signal, the oscillations immediately following the 

40 excitation impulse, which oscillations, as stated, are the most significant ones. If the check yields a positive result, a 
possible candidate is searched among the zero crossings that were found (step 13) and subsequently a first phase of 
search for the left synthesis and analysis edges b^Q, is can-ied out (step 14). If at the end of step 14 no suitable zero 
crossing has been found, a search continuation phase is started (step 15) and, if after this phase the left synthesis and 
analysis edges have not yet been identified, then a phase of continuation and conclusion of the search is started (step 

45 1 7). If the comparison in step 12 indicates that the number of zero aossings is lower than the threshold, then the zero 
crossing with index J = lndZ_Min is arbitrarily considered as a candidate (step 1 8) and a search for bga and b^s (step 
19). identical to the one earned out in step 14, is performed: if this search is unsuccessful, then step 1 7. i.e. the search 
continuation and conclusion, is directly started, without going through step 15. for reasons that will become clear when 
the latter is desaibed. 

50 A step analogous to step 1 7 is envisaged also in case of lengthening of the fundamental period in synthesis, as will 
be seen further on. For the sake of simplicity, the same flow chart was used for tx>th cases, which are distinguished by 
means of some conditions of entry into the step itself. In particular, for the case p^ ^ pa the conditions r_P ^ 1 (where 
r_P is the ratio Ps/Pa). Start = 0, End = LZV . Step = +1 (step 1 6 in Figure 1 1 ) are set. The first condition is evident. The 
other three indicate that the cycle of examination of the zero crossings envisaged in phase 1 7 will be carried out in the 

55 order of increasing indexes. 

The operations performed in steps 1 3-1 5 and 1 7 will be described in detail further on. with reference to Figures 1 4 
-17. 

Figure 12 is the general flow chart of the operations carried out if the synthesis period Pa is longer than the analysis 
period Pa- The first operation (step 21) consists again in corrputing function ZCR and is identical to step 1 1 in Figure 
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1 1 . Subsequently (step 22) a search is carried out for the left synthesis and analysis edges, with procedures that will be 
desaibed with reference to Figure 18, and, if this phase does not have a positive outcome, a search continuation and 
conclusion phase is initiated (step 24). corresponding to step 1 7 in Figure 1 1 . Conditions r_P > 1 , Start - LZV- 1 . End 
= '1 , Step = -1 are set for the operations envisaged in step 24, The first condition is evident. The other three indicate 
5 that the cycle of examination of the zero crossings envisaged in step 24 will be carried out in this case in the order of 
decreasing indexes. 

Figure 1 4 shows the flow chart of the search for a zero crossing which is candidate to act as left analysis and 
synthesis edge (step 13 in Figure 11). J denotes the index of the candidate. In particular, the c^al zero crossing, 
whose index is J = (LZV+1)/2 (step 1 30), is initially examined as a candidate and its abscissa ZCR(J) is compared with 

10 the right synthesis edge b^s (step 1 3 1 ). If this initial candidate is already on the left of the right synthesis edge, the phase 
of search for the left analysis and synthesis edge (step 14, Figure 1 1) is started directly. In the opposite case, zero 
crossings on the left of the central one are examined with a backwards cycle, searching for a candidate whose abscissa 
is on the left of b^s (steps 132-134). When a zero crossing that meets this condition is found, it is considered as a 
candidate (step 135) and the search phase (step 14 in Figure 1) is started after verifying that the index of the candidate 

IS is not (L2V-i-1)/2 (step 136). In effect, a backward search cycle has been performed because the initial candidate, with 
index (LZV-i-1 )/2. was on the right of b^s. and hence obtaining a candidate with that index signals an anomalous condition: 
if this occurs, the search phase is started after setting J=0. The same operations are performed if the cycle ends before 
a candidate is found. 

Figure 15 shows the operations carried out for the first phase of search for b^s, bga (step 14 in Figure 1 1). For this 

20 search, a backward examination is made of the zero crossings starting from the one preceding LZV, and the distance 
Diff_z_a between the right analysis edge b^a and the current zero crossing ZCR(i) is calculated (steps 140, 141). This 
distance, multiplied by r_P (ratio between the synthesis period Ps and the analysis period pj is compared with Diff_a_s 
(step 142), to check that there is a time interval sufficient to apply the connecting function. Weighting with r_P links the 
duration of that function to the percentage shortening of the period and it is aimed at guaranteeing a good connection 

25 between subsequent intenmls. If Diffja.s > Diff.z_a*r_P , the search cycle continues (step 143), until a zero crossing 
is found such that Diff_a_s ^ (Oiff_z_aV_P) or until all zero crossings have been considered: in the latter case step 1 4 
is ended and step 15 (Figure 1 1) of search continuation, is started. When the condition Diff_a_s ^ Diff_z_aV_P is met, 
the current index i is compared with index J of the candidate (step 144). If i < J, the cycle is continued. If the two indexes 
are equal, then the current zero crossing is considered as left analysis edge bga and as left synthesis edge bgs (step 

30 1 47) ; if instead i > J, then distance A_a between the right analysis edge b^a and the current zero crossing ZCR(i), distance 
A_s between the right synthesis edge bds and the current zero crossing ZCR(i), and ratio A between A_s and A_a are 
calculated (step 145). and ratio A is compared to the value (r_P)/2 (step 146). If A ^ (r_P)/2 , then the tasks of left 
analysis edge and left synthesis edge b^g are assigned to the cunent zero crossing (step 1 47). otherwise phase 1 5 
(Figure 1 1) of search continuation is started. The last comparison indicates that not only a sufficient distance between 

35 the left and right synthesis edge is required, but also that the connecting function takes into account the shortening in 
synthesis; this, too. helps obtaining a good connection between adjacent intervals. 

Variable TRUE" in the last step 147 in Figure 15 indicates that to^ and have been found and disables subsequent 
search phases. The same variable will also be utilized with the same meaning in the other flow charts related to the 
search for the left analysis and synthesis edges. 

40 Step 1 4 allows finding a candidate, if any, that lies on the left of the right synthesis edge and is as close as possible 
to it, while guaranteeing a time interval sufficient to apply the connecting function; this step is the core of the aiterion 
of the search for bga and b^. 

Search continuation step 15 is illustrated in detail in Figure 16. This step, if it is performed (negative result of phase 
14 and therefore of the check on the TRUE condition in step 150), starts with a new comparison between LZV and 

45 lndZ_min (step 151). aimed now at just verifying whether LZV > IndZ.min. If the condition is not met. then step 17. of 
search continuation and conclusion is initiated, tf LZV > lndZ_Min, then a check is made on whether the zero crossing 
having index IndZ.Min is positioned on the left of the right synthesis edge bds (step 1 52). In the affirmative, this crossing 
is considered to be the left analysis edge bga and left synthesis edge bgs (step 1 53). If instead the zero crossing having 
index lndZ_Min is still on the right of the right synthesis edge, then step 17 (Figure 11) of search continuation and 

so conclusion is initiated. 

Search continuation and conclusion step 1 7 is represented in detail in Figure 1 7. After checking the need to perform 
it (step 170). tiie zero crossings are reviewed again, in increasing index order. In tiie examination cycle (steps 171-174 
in Figure 1 7), a check is made at each step on whether tine current zero aossing (indicated by Z_Tmp) is on the left of 
the right synthesis edge b^s and its distance from such edge is not lower than a predetermined minimum value 5. e.g. 
55 10 Signal samples (step 1 73). If the two conditions are not met, ttien the subsequent zero crossing Is examined (step 
174). othenivise tills zero crossing is temporarily considered as the left synthesis and analysis edge (step 175) and tiie 
cyde is continued. Tiie last zero crossing ttiat meets condition 173 will be considered as the left synthesis and analysis 
edge (step 1 79). The check on r.P at step 1 76 is an additional means to distinguish between tiie case Ps ^ Pa and tiie 
case Pa > Pa. and it causes steps 1 77 and 1 78 of the flow chart to be omitted in the case being examined. 
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Figure 18 illustrates the search for b^^ and bgs when the synthesis pericxi is lengthened with respect to the analysis 
period. This search starts with a con^rison between the lengthening in synthesis Diff_a_s and half the duration of the 
analysis period Pa (step 220). If Diff_a_s >p^/2, step 24 (illustrated in detail in Figure 17) is started directly. If 
Diff_a_s ^ Pa/2 , a backward search cycle is carried out. starting from the zero crossing preceding LZV. Distance 

5 Diff js_a between the right analysis edge b^a and the current zero crossing ZCR(i) (steps 221 , 222) is calculated and is 
compared with Diff.a.s (step 223): if It is smaller, then the search cycle continues (step 224), othenivise the current zero 
crossing is considered as the left analysis and synthesis edge (step 225). If, at the end of the cycle, b^a and have 
not been determined, then the phase of search continuation and conclusion is initiated (phase 24, Figure 12). 

If the lengthening required in synthesis is less than or equal to half the analysis period, the operations descrit>ed 

10 above allow finding a candidate, if any, that is the first for which the distance from the right analysis edge exceeds or is 
equal to the required lengthening. 

In the search continuation and conclusion phase, a backward search cycle is carried out, as stated, starting from 
the zero crossing preceding LZV, with the procedures illustrated in steps 171 - 175 in Figure 17. Moreover, since a 
lengthening of the interval is considered (step 1 76), distance A_a between the right analysis edge b^a and the current 

IS zero crossing Z.Tmp, distance A_s between the right synthesis edge b^g and the current zero crossing Z_Tmp and ratio 
A between these distances are computed (step 177) for the zero crossings that meet the conditions of step 173. Ratio 
A is compared with twice the ratio between the periods (r_P*2) for the same reasons seen for comparison 1 46 in Figure 
1 5. and the zero crossing that meets the condition A g (r_P'^2) will be taken as left analysis edge bsa and left synthesis 
edge bsg. 

20 The conditions imposed in this phase allow assigning the task of left analysis edge to a zero crossing that lies on 
the left of the right synthesis edge, is as close as possit>le to it and also guarantees a sufficient time interval for the 
connecting function to be applied: in particular, given a certain analysis period, a left analysis edge positioned farther 
back in the original period will correspond to a greater lengthening required in synthesis. 

The method described herein can be performed by means of a conventional personal computer, workstation, or 

25 similar apparatus. 

It is evident that what is described above is given by way of non-limiting example and that variations and modifications 
are possible without departing from the scope of the invention. 
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Claims 



1 . Method for speech signal synthesis by means of time concatenation of waveforms representing elementary speech 
signal units, in which: at least the waveforms associated to voiced sounds are sutxlivided into a plurality of intervals, 
corresponding to the responses of the vocal duct to a series of impulses of vocal cord excitation, synchronous with 
the fundamental frequency of the signal; the waveform in each interval is weighted; the signals resulting from the 
35 weighting are replaced with a replica thereof shifted in time by an anrK)unt depending on a prosodic information; and 
synthesis is performed by overlapping and adding the shifted signals; 
characterized in that: 

a cun^ent interval of original signal to be reproduced in synthesis is subdivided into an unchanging part, which 

40 lies between the interval beginning and a left analysis edge represented by a zero crossing of the original speech 

signal which meets predetermined conditions, and a variable part, which lies between the left analysis edge 
and a right analysis edge that essentially coinddes with the end of the current inten^al, the left and right analysis 
edges being associated, in the synthesized signal, respectively with a left synthesis edge and a right synthesis 
edge, of which the former coincides with the left analysis edge, with reference to a start-of-interval marker, and 

45 the latter coincides essentially with the end of the interval in the synthesized signal; 

a first connecting function is applied on the part of waveform on the right of the left analysis edge of the current 
interval of original signal, which function has a duration equal to that of the segment of synthesized waveform 
lying between the left and right synthesis edges and an amplitude that progressively decreases and is nnaximum 
in correspondence with the left analysis edge; 

50 - a second connecting function is applied on the part of waveform on tiie left of the subsequent interval of original 
signal to be reproduced in synthesis, which function has a duration equal to that of tiie segment of synthesized 
waveform lying between the left and right synthesis edges and an amplitude tiiat progressively increases and 
is maximum in correspondence with ttie beginning of said subsequent interval; 
- each interval of synfliesized signal is built by reproducing unchanged the waveform in the unchanging part of 

55 tiie original interval and by joining tiiereto tiie waveform obtained by aligning in time and adding the two wave- 

forms resulting from applying the two connecting functions. 
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Method according to claim 1 . characterized in that, if the duration of an interval is reduced or maintained unchanged 
for the synthesis with respect to the duration of the conresponding interval of the original signal, the left analysis 
edge and the left synthesis edge are determined with the following operations: 

- computing the number of zero crossings of the original signal waveform and assigning each zero crossing an 
index, increasing from the beginning towards the end of the interval; 

- checking that the number of zero crossings is not tower than a first threshold; 

- searching, in case of positive outcome of the check, for a zero crossing candidate to act as left analysis and 
synthesis edge; 

backwards searching, anfK}ng all zero crossings in the interval, except the last one. for a candidate that lies on 
the left of the right synthesis edge, is as close as possible to it and guarantees a time interval sufficient for the 
connecting functions to be applied, and assigning the task of left analysis and synthesis edge to this candidate. 

Method according to claim 2, characterized in that, in said computation of the zero aossings. zero crossings whose 
distance from the previous one is lower than a predetermined distance are not taken into consideration. 

Method according to claim 2 or 3. characterized in that, if the t>ackwards search has yielded a negative result and 
if the number of zero crossings is higher than the first threshoki, the tasks of left analysis edge and left synthesis 
edge are assigned to the zero crossing whose index con^esponds to said threshold, if such a zero aossing lies on 
the left of the right synthesis edge. 

Method according to any of claims 2 to 4, characterized in that if the backwards search has yielded a negative result 
and if the number of zero crossings is not higher than the first threshold, a further search phase is carried out to 
identify the zero crossings lying on the left of the right synthesis edge and having a distance from the latter that is 
not lower than a second threshokJ. and the tasks of left analysis edge and right analysis edge are assigned to the 
highest index zero crossing which meets these conditions. 

Method according to any of claims 2 to 5. characterized in that, if the comparison with the first threshold indicates 
that the number of zero crossings is lower than the first threshold, said backwards search is performed directly and. 
if it yields negative a result, said further search phase is performed directly. 

Method according to any of claims 1 to 6. characterized in that, if the duration of the interval is increased for the 
synthesis compared to the duration of the corresponding interval of the original signal, the left analysis edge and 
the right synthesis edge are determined with the following operations: 

computing the number of zero aossings of the original signal waveform; 

comparing the duration lengthening of the synthesis interval and the duration of the original interval, to check 
that the lengthening does not exceed half the original interval duration; 

if the check yields a positive result, searching backwards, among all the zero crossings except the last one. for 
a candidate zero crossing that lies on the left of the right synthesis edge and is the first for which the distance 
from the right synthesis edge is not shorter than the lengthening of the interval duration, the tasks of left analysis 
edge and left synthesis edge being assigned to the zero crossing that meets said condition, if any. 

Method according to claim 7. characterized in that, in sakl computation of the zero crossings, the crossings whose 
distance from the previous crossing is lower than a predetemnined distance are not taken into consideration. 

Method according to daim 7 or 8, characterized in that, if the inten/al duration lengthening exceeds half the original 
interval duration or if the backwards search is unsuccessful, a further backwards search phase is carried out to 
identify the zero aossings lying on the left of the right synthesis edge and having a distance from the latter that is 
not lower than a third threshold; the distances from the right synthesis edge and from the right analysis edge and 
the ratio between these distances are computed for such zero crossings; sakl ratio is compared with the value of 
the ratio between the duration of the synthesis interval and the duration of the original interval, and the tasks of left 
analysis edge and left synthesis edge are assigned to the zero aossing whose index is the lowest among those for 
which the ratio between the distances from the edges does not exceed by more than a predetermined factor the 
ratio between durations. 
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Description 

[0001] The invention described herein relates to speech synthesis and more particularly to a synthesis method based 
on the concatenation of waveforms related to elementary speech units. Preferably, but not exclusively, the method is 

5 applied to text-to-speech synthesis. 

[0002] In these applications, a text to be transformed into a speech signal is first converted into a phonetic-prosodic 
representation, which indicates the sequence of corresponding phonemes and the prosodic characteristics (duration, 
intensity, and fundamental period) associated to them. This representation is then converted into a digital synthetic 
speech signal starting from a vocabulary of said elementary units, which in the most common case are constituted of 

10 diphones (voice elements extending from the stationary part of a phoneme to the stationary part of the subsequent 
phoneme, the transition between phonemes included). For the Italian language, a vocabulary of about one thousand 
diphones ensures the phonetic coverage, allowing all admissible sounds for Italian language to be synthesized. 
[0003] In systems for text-to-speech synthesis, methods based on the concatenation, in the time domain, of the 
waveforms representing the various elementary units can be used for the generation of the speech signal: these meth- 

IS ods are very flexible and guarantee good synthetic speech quality. 

[0004] An example is described by E. Moulines and F. Charpentier in the paper "Pitch-synchronous waveform 
processing techniques for text-to-speech synthesis using diphones", Speech Communication, Vol. 9, No. 5/6, Decem- 
ber 1990, pages 453-467. This method Is based on the technique known as PSOLA (Pitch-Synchronous Overlap and 
Add), to apply the prosody imposed by the synthesis rules and concatenate the waveforms of the elementary units. At 

20 least for the voiced segments of the original signal, the PSOLA technique carries out an analysis by applying a pitch- 
synchronous windowing, In particular by using Manning windows whose duration is roughly twice the fundamental 
period (pitch period), thereby generating a sequence of partially overlapping short-term signals; In the synthesis phase, 
the signals resulting from the windowing are shifted in time synchronously with the fundamental period imposed by the 
prosodic rules for synthesis; finally, the synthetic signal is generated by overlapping and adding the shifted signals. To 

25 reduce computational complexity, the second step can be carried out directly in the time domain, 

[0005] The complete windowing of the individual intervals of the original signal requires a relatively heavy computa- 
tional load and moreover it constitutes an alteration of the original signal extending over the entire interval, so that the 
synthetic signal sounds less natural. 

[0006] According to the invention, a synthesis method is provided in which that part of each interval of the original 
30 signal which contains the fundamental information Is left unchanged, and only the remaining part of the interval is 
altered: this way, not only processing time is reduced, but the natural sounding of the synthetic signal is also improved, 
since the main part of the interval is the exact reproduction of the original signal. 

[0007] The invention therefore provides a method for the speech signal synthesis by means of time-concatenation 
of wavefonns representing elementary speech signal units, in which: at least the waveforms associated to voiced 
35 sounds are divided into a plurality of intervals, corresponding to the responses of the vocal duct to a series of impulses 
exciting the vocal cords synchronously with the fundamental frequency of the signal; the waveform in each interval is 
weighted; the signals resulting from the weighting are replaced with a replica thereof, shifted in time by an amount 
depending on a prosodic information; and the synthesis is carried out by overlapping and adding the shifted signals; 
and in which: 

40 

a current interval of original signal to be reproduced In synthesis Is subdivided into an unchanging part, which lies 
between the interval beginning and a left analysis edge represented by a zero crossing of the original speech 
signal that meets predetermined conditions, and a changeable part, which lies between the left analysis edge and 
a right analysis edge essentially coinciding with the end of the current interval, the left and right analysis edges 
45 being associated, in the synthesized signal, respectively with a left and a right synthesis edge, of which the former 

coincides with the left analysis edge, with reference to a start-of-interval marker, and the latter coincides essentially 
with the end of the Interval in the synthesized signal; 

a first connecting function, which has a duration equal to that of the segment of synthesized waveform lying between 
the left and right synthesis edges and an amplitude which decreases progressively and is maximum in correspond- 
50 ence with the left analysis edge, is applied on the part of waveform on the right of the left analysis edge of the 

current interval of original signal; 

a second connecting function, which has a duration equal to that of the segment of synthesized waveform lying 
between the left and right synthesis edges and an amplitude which increases progressively and is maximum in 
correspondence with the beginning of said subsequent interval, is applied on the part of waveform on the left of 
55 the subsequent interval of original signal to be reproduced synthetically; 

each interval of synthesized signal is built by reproducing unchanged the waveform in the unchanging part of the 
original Interval and by joining thereto the waveform obtained by aligning in time and adding the two waveforms 
resulting from the application of the first and second connecting functions. 



4 
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[0008] For the sake of further clarification, reference is made to the enclosed drawings, which illustrate an embodi- 
ment of the invention given by way of non-limiting example and where: 

Figure 1 is the general outline of the operations of a text-to-speech synthesis system through concatenation of 
5 elementary acoustic units; 

Figure 2 is a diagram of the synthesis method through concatenation of diphones and modification of the prosodic 
parameters in the time domain, according to the invention; 

Figure 3 represents the waveform of a real diphone, with the markers for the phonetic and diphone borders and 

the pitch markers; 

10 . Figures 4, 5 and 6 are graphs representing how the prosodic parameters of a natural speech signal are modified 
in some particular cases, according to the invention; 

Figures 7A, 7B, 8A, 8B, 9A, 9B. 10A and 108 are some real examples of application of the method according to 
the invention for the modification of the fundamental period on segments of the diphone in Figure 3; 
Figures 11 - 18 are flow charts of the operations for determining the left analysis and synthesis edge. 

15 

[0009] Before describing the invention in detail, the structure of a text-to-speech synthesis system is briefly described. 
[0010] As can be seen in Figure 1, as a first phase the written text is fed to a linguistic processing stage TL which 
transforms the written text into a pronounceable form and adds linguistic markings: transcription of abbreviations, 
numbers application of stress and grammatical classification rules, access to lexical information contained in a 

20 special vocabulary VL. The subsequent stage. TF, carries out the transcription from orthographic sequence to the 
corresponding string of phonetic symbols. On the basis of a set of prosodic rules RP, a prosodic processing stage TP 
provides duration and fundamental period (and thus also fundamental frequency) for each of the phonemes leaving 
TF. This information is then provided to a pre-synthesis stage PS, which determines for each phoneme, the sequence 
of acoustic signals forming the phoneme (access to diphone data base VD) and. for each segment, how many and 

25 which intervals, with duration equal to the fundamental period, are to be used (in the case of voiced sounds) and the 
corresponding values of the fundamental period to be attributed in synthesis. These values are obtained by interpolating 
the values assigned in correspondence with the phoneme borders. In the case of unvoiced or "surd" sounds, in which 
there are no periodicity characteristics, the intervals have a fixed duration. This information is finally used by an actual 
synthesizer SINT which performs the transformations required to generate the synthetic signal. 

30 [0011] Figure 2 illustrates in greater detail the operation of modules PS and SINT. The input is constituted by the 
current phoneme identifier Fj, by the phoneme duration Dj and by the values of the fundamental period Pj.-! at the 
beginning of the phoneme and Pj at the end of the phoneme, and by the Identifiers of the previous phoneme F^^_^ and 
of the subsequent one Fj^.^. The first operation to be performed is to decode diphones DFi.^ and DFj and to detect the 
markers of diphone beginning and end and of phoneme border. This information is drawn directly from the data base 

35 or vocabulary storing diphones as waveforms and the related border, voiced/unvoiced decision and pitch marking 
descriptors. The subsequent module transforms said descriptors taking the phoneme as a reference. On the basis of 
this information, a rhythmic module computes the ratio between duration D; imposed by the rule and the intrinsic duration 
of the phoneme (memorized in the vocabulary and given by the sum of the two portions of the phoneme belonging to 
the two diphones DFj.^) and DFj). Then, taking into account the modification of the duration, it computes the number 

^0 of intervals to be used in synthesis and determines the value of the fundamental period for each of them, by means of 
a law of interpolation between values P^^,^ and P|. The value of the fundamental period is then actually used only for 
voiced sounds, while for unvoiced sounds, as stated above, intervals are considered to be of fixed duration. 
[0012] For the actual synthesis, the operations are different depending on whether the sound Is voiced or unvoiced. 
[0013] In the case of unvoiced sound, the synthesis demands a simple time shift (lengthening or shortening) of the 

^5 aforesaid intervals on the basis of the ratio between the duration imposed by the prosodic rules and the intrinsic duration. 
In the case of voiced sound, instead, the method according to the invention is applied. 

[0014] The synthesis method according to the invention starts from the consideration that a voiced sound can be 
considered as a sequence of quasi-periodic intervals, each defined by a value of the fundamental period. This is 
clearly seen in Figure 3, which shows the waveform of diphone "d_m", the related markers separating individual intervals 

50 and, for each interval, value Pg of the corresponding period expressed in Hz. The part of Figure 3 between the two 
markers V corresponds to the right portion of phoneme "^"; the part between the second marker V and the end-of- 
diphone marker T corresponds to the left part of phoneme "m". The aforesaid intervals may be considered as the 
impulse responses of a filter, stationary for some milliseconds and corresponding to the vocal duct, which is excited 
by a sequence of impulses synchronous with the fundamental frequency of the source (vibrating frequency of the vocal 

55 cords). For each interval the synthesis module is to receive the original signal with fundamental period Pg (analysis 
period) and to provide a signal modified with period p^ (synthesis period) required by prosodic rules. 
[0015] The essential infomnation characterizing each speech interval is contained in the signal part immediately 
following the excitation impulse (main part of the response), while the response itself becomes less and less significant 
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as the distance from the impulse position increases. Taking this into account, in the synthesis method according to the 
invention this main part is maintained as unchanged as possible and the lengthening or shortening of the period required 
by the prosodic rules are obtained by acting on the remaining part. 

[0016] For this purpose, an unchanging and a changeable part are then identified in each interval, and only the latter 
5 is involved in connection, overlap and add operations. The unchanging part of the original signal is not constant, but 
rather it depends for each interval on the ratio between Pg and Pg. This unchanging part lies between the start-of- 
interval marker and a so-called left analysis edge b^g, which is one of the zero crossings of the original speech signal, 
identified with criteria that will be described further on and that can be different depending on whether the synthesis 
period is longer, shorter or equal to the analysis period. The changeable part is delimited by the left analysis edge bgg 
10 and by a so-called right analysis edge b^g. which essentially coincides with the end of the interval, in particular with 
the sample preceding the start-of-intervat marker of the subsequent interval. 

[001 7] In the synthesized signal, a left and a right synthesis edge bgs. b^s will correspond to the left and right analysis 
edge bga, b^g- For a given interval, the left synthesis edge obviously coincides with the left analysis edge, with reference 
to the start-of-interval marker, since the preceding part of signal is reproduced unaltered in the synthesis. The right 
15 synthesis edge Is defined by relation 

bds = b33 + Ap (1) 

^0 where Ap = Pg - Pg will have a positive or negative value depending on whether, in synthesis, there is a lengthening or 
shortening of the fundamental period. 

[0018] The changeable part of the interval is modified by applying a pair of connecting functions whose duration is 
As = b^s - bgg. The first function has a maximum value (specifically 1) in correspondence with the left analysis edge 
and a minimum value (specifically 0) in con^espondence with the point b^^ + As. The second function has a maximum 
25 value (specifically 1) in correspondence with the right analysis edge b^^ and a minimum value (specifically 0) in cor- 
respondence with point b^g ' connecting functions can be of the kind commonly used for these purposes (e. 
g. Manning windows or similar functions). 

[0019] For the sake of further clarifying the invention, Figures 4-6 show some graphs Illustrating the application of 
the method to a fictitious signal. In these Figures, part A shows three consecutive intervals of the original signal, with 

^0 indexes i-1 , i, i-i-1 , and indicates also their fundamental periods Pgh (h = i-1 , t, i+1 ) as well as pitch (or start-of-interval) 
markers Ma and the left and right analysis edges bga. b^g- Parts B and C show, for each interval, respectively the first 
and second connecting functions (which hereinafter shall be called for the sake of simplicity "function B" and "function 
C") and the time relations with the original signal. Part D shows the synthesized signal wavefonns resulting from the 
method according to the invention, with the indication of the respective fundamental periods Psk (k = j-1 , j, j+1 ), of pitch 

35 markers Ms and of left and right synthesis edges bgg. b^g- P^*^ E is a representation of the waveform portion where, 
after the time shift, the waveforms obtained with the application of the two connecting functions to the changeable part 
of the original signal are submitted to the overiapping and adding process. Note that the serial numbers of the Intervals 
in analysis and synthesis can be different, since suppressions or duplications of intervals may have occurred previously. 
[0020] In particular, Figure 4 illustrates the case of an increase in fundamental period (and therefore decrease in 

^0 frequency) in synthesis with respect to the original signal, in a signal portion where no interval suppressions or dupli- 
cations have occurred. Weighting is carried out in each interval with a respective pair of connecting functions. As a 
consequence of the period increase, duration As of the functions is greater than the length of the variable part of the 
original signal, so that function B also interests the beginning of the waveform related to the subsequent interval, while 
function C interests a part of waveform on the left of the left analysis edge. 

45 [0021] Figure 5 shows an analogous representation in the case of decrease in fundamental period (and therefore 
Increase in frequency) in synthesis with respect to the original signal. In this example too no interval suppressions or 
duplications occurred. In this case functions B, C interest a waveform portion with shorter duration than the portion 
lying between bga and b^ja- 

[0022] Finally, Figure 6 shows an example of increase in fundamental period in synthesis in the case of suppression 
50 of an interval of the original signal (the one with index i in the example). Two intervals are obtained in synthesis. Indicated 
by indexes j-1 and j. which intervals respectively maintain, as unchanging part, the one of intervals with index i-1 and 
i-t-l in the original signal. The interval with index i+1 in the original signal is processed in the same way as each interval 
of original signal in Figure 4. The modified part of the interval with index j-1 in the synthesized signal, instead, is obtained 
by overiapping and adding the two waveforms obtained by weighting only with function B the changeable part of the 
55 interval with index i-1 in the original signal, and by weighting only with function C the final part of the interval with index 
i in the original signal. In other words, function B is applied on the right of b^g in the current interval to be reproduced 
in synthesis, and function C is applied on the left of the subsequent interval to be reproduced. These procedures of 



* 
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application of the connecting functions are quite general and are appiied also In case of interval duplication and diphone 
change. 

[0023] Purely by way of example, for the diagrams In figures 4 - 6 the following functions were utilized: 

0.5 - 0.5cos{7c[(As-1 +bss-Xi)/(As-1 )]"} (function B) 

0,5 - 0.5cos{7c[(X|-b5s)/(As-1 )]"} (function C) 



[0024] In these functions, bgg. As have the meaning seen previously and are expressed as a number of samples; Xj 
is the generic sample of the variable part of the original waveform (with bgg ^ Xj < bgg + As, for function B, and b^jg - As 
^ xi < bda for function C); n is a number which can vary (e.g. from 1 to 3) depending on ratio As/pgi in particular, in the 
drawing, n was considered to be 1 . Obviously, in the fomiulas. value 0.5 can be replaced by a generic value A/2 if a 

*5 function whose maximum is A instead of 1 is used, or by a pair of values whose sum is 1 (or A). 

[0025] Figures 7A, 7B to IDA. 10B represent some real examples of application of the method, for two portions of 
diphone "d.m" of Figure 3. utilized in two different positions in the sentence where the synthesis rules require respec- 
tively a decrease and an increase in fundamental period (and therefore an increase and respectively a decrease in 
fundamental frequency). For all intervals, pitch markers, left analysis and synthesis edges and fundamental frequency. 

^0 both in analysis and synthesis, are indicated. Figures with letter A show the original waveform and Figures with letter 
B the synthesized signal. Figures 7A, 7B, 8A, 8B show the first two intervals of the diphone being examined (phoneme 
"d") in case of increase (Figures 7A, 7B) and respectively of decrease (Figures 8A, SB) of the fundamental frequency. 
Figures 9A. 9B. 10A, 10B show instead the first two intervals of phoneme "m" in the same conditions as illustrated In 
Figures 7, 8. As an effect of the frequency decrease, only the first interval is completely visible in Figures 8B and 1 0B. 

25 [0026] A preferred embodiment of the method adopted to identify the left analysis and synthesis edge for each interval 
to be reproduced in synthesis will now be described. In the example described, a different method is used depending 
on whether the fundamental period in synthesis is smaller than or equal to the period in analysis, or it is greater. 
[0027] Figure 11 is the general flow chart of the operations carried out if Pg < Pg. 

[0028] The first operation is the computation of function ZCR (Zero Crossing Rate) indicating the number of zero 
30 crossings (step 11). In this computation, zero crossings that are spaced apart from the previous one by less than a 
limited number of signal samples (e.g. 10) are neglected, in order to eliminate non-significant oscillations of the signal. 
[0029] As can be seen in Figure 13, the zero crossings that are considered are assigned an index varying from 1 to 
the descriptor of the total zero crossing number LZV (step 110). Moreover, the following variables are assigned (step 
111): 

35 

b(j3 (right analysis edge) to the value of analysis period Pg; 

b^js (right synthesis edge) to the value of synthesis period b^^ + Ap; 

Diff_a_s to the absolute value |Ap| of the difference between the analysis and synthesis periods. 

40 [0030] In these relations, as in those examined further on. the values of the periods and the lengths of certain intervals 
are expressed in terms of number of samples. 

[0031] Going back to Figure 11. after computing function ZCR, a check is made (step 12) that the number of zero 
crossings found in step 11 is not lower than a minimal threshold of zero crossings lndZ_Min (e.g. 5 crossings). Actually, 
according to the invention, it is desired to reproduce unaltered, in the synthesized signal, the oscillations immediately 
following the excitation impulse, which oscillations, as stated, are the most significant ones. If the check yields a positive 
result, a possible candidate is searched among the zero crossings that were found (step 13) and subsequently a first 
phase of search for the left synthesis and analysis edges bgg, bga is carried out (step 14). If at the end of step 14 no 
suitable zero crossing has been found, a search continuation phase is started (step 15) and, if after this phase the left 
synthesis and analysis edges have not yet been identified, then a phase of continuation and conclusion of the search 
is started (step 17). Ifthe comparison in step 12 indicates that the number of zero crossings Is lower than the threshold, 
then the zero crossing with index J = lndZ_Mln is arbitrarily considered as a candidate (step 18) and a search for b^g 
and bs3 (step 19). identical to the one carried out in step 14, is performed: if this search is unsuccessful, then step 17, 
i.e. the search continuation and conclusion, is directly started, without going through step 15. for reasons that will 
become clear when the latter is described. 
55 [0032] A step analogous to step 1 7 is envisaged also in case of lengthening of the fundamental period in synthesis, 
as will be seen further on. For the sake of simplicity, the same flow chart was used for both cases, which are distinguished 
by means of some conditions of entry into the step itself. In particular, for the case Pg < Pg the conditions r_P < 1 (where 
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r_P is the ratio pjp^). Start = 0. End = LZV. Step = (step 16 in Figure 11 ) are set. The first condition is evident. The 
other three Indicate that the cycle of examination of the zero crossings envisaged in phase 17 wilt be carried out in the 
order of increasing Indexes. 

[0033] The operations performed in steps 1 3-15 and 1 7 will be described in detail further on, with reference to Figures 
5 14-17. 

[0034] Figure 12 is the general flow chart of the operations carried out if the synthesis period p^ is longer than the 
analysis period Pg. The first operation (step 21) consists again in computing function ZCR and is identical to step 11 
in Figure 11. Subsequently (step 22) a search is carried out for the left synthesis and analysis edges, with procedures 
that will be described with reference to Figure 18, and, if this phase does not have a positive outcome, a search 
10 continuation and conclusion phase is initiated (step 24), corresponding to step 17 in Figure 11. Conditions r_P > 1, 
Start = LZV-1, End = -1, Step = -1 are set for the operations envisaged in step 24. The first condition is evident. The 
other three indicate that the cycle of examination of the zero crossings envisaged in step 24 will be carried out in this 
case In the order of decreasing indexes. 

[0035] Figure 14 shows the flow chart of the search for a zero crossing which is candidate to act as left analysis and 

15 synthesis edge (step 13 in Figure 11). J denotes the index of the candidate. In particular, the central zero crossing, 
whose index Is J = (l.ZV+1 )/2 (step 1 30), is initially examined as a candidate and its abscissa ZCR(J) is compared with 
the right synthesis edge b^s (step 131). If this initial candidate is already on the left of the right synthesis edge, the 
phase of search for the left analysis and synthesis edge (step 14, Figure 11 ) is started directly. In the opposite case, 
zero crossings on the left of the central one are examined with a backwards cycle, searching for a candidate whose 

20 abscissa is on the left of b^js (steps 132-134). When a zero crossing that meets this condition is found, it is considered 
as a candidate (step 135) and the search phase (step 14 in Figure 11) is started after verifying that the index of the 
candidate is not (LZV+1)/2 (step 136). In effect, a backward search cycle has been performed because the initial 
candidate, with index (LZV-i-1)/2, was on the right of b^g, and hence obtaining a candidate with that index signals an 
anomalous condition: If this occurs, the search phase is started after setting J=0. The same operations are performed 

25 jf the cycle ends before a candidate is found. 

[0036] Figure 1 5 shows the operations carried out for the first phase of search for bgg, bgg (step 14 in Figure 11). For 
this search, a backward examination is made of the zero crossings starting from the one preceding LZV, and the 
distance Dlff_z_a between the right analysis edge b^jg 3nd the current zero crossing ZCR(I) is calculated (steps 140, 
141). This distance, multiplied by r_P (ratio between the synthesis period Ps and the analysis period Pg) Is compared 

30 with Diff_a_s (step 142), to check that there is a time interval sufficient to apply the connecting function. Weighting with 
r_P links the duration of that function to the percentage shortening of the period and it is aimed at guaranteeing a good 
connection between subsequent intervals. If Diff__a_s > Dlff_z_aV_P, the search cycle continues (step 143), until a zero 
crossing is found such that Diff_a_s ^ (Diff_z_a*r_P) or until all zero crossings have been considered: in the latter case 
step 14 Is ended and step 15 (Figure 11) of search continuation, Is started. When the condition Diff_a_s^ Dlff_z_aV_P 

35 is met, the current index i is compared with index J of the candidate (step 144). If i < J, the cycle is continued. If the 
two Indexes are equal, then the current zero crossing is considered as left analysis edge bgg and as left synthesis edge 
^ss (step 147); if instead i > J. then distance A_a between the right analysis edge b^a and the current zero crossing 
ZCR(i), distance A_s between the right synthesis edge b^^ and the current zero crossing ZCR(i), and ratio A between 
A_s and A_a are calculated (step 145), and ratio A is compared to the value (r_P)/2 (step 146). If A < (r_P)/2, then the 

^0 tasks of left analysis edge b^g and left synthesis edge bgg are assigned to the current zero crossing (step 1 47), othen/vise 
phase 15 (Figure 11 ) of search continuation is started. The last comparison indicates that not only a sufficient distance 
between the left and right synthesis edge is required, but also that the connecting function takes into account the 
shortening In synthesis; this, too, helps obtaining a good connection between adjacent intervals. 
[0037] Variable "TRUE" In the last step 147 in Figure 15 indicates that bgg and b^^ have been found and disables 

^5 subsequent search phases. The same variable will also be utilized with the same meaning in the other flow charts 
related to the search for the left analysis and synthesis edges. 

[0038] Step 14 allows finding a candidate, if any, that lies on the left of the right synthesis edge and is as close as 
possible to it, while guaranteeing a time interval sufflcient to apply the connecting function; this step is the core of the 
criterion of the search for b^ and bgg- 

50 [0039] Search continuation step 15 is illustrated in detail In Figure 16. This step, if it is performed (negative result of 
phase 14 and therefore of the check on the TRUE condition In step 150), starts with a new comparison between l_ZV 
and lndZ_min (step 151), aimed now at just verifying whether LZV > lndZ_min. If the condition is not met, then step 
17, of search continuation and conclusion Is initiated. If LZV > lndZ_Min, then a check is made on whether the zero 
crossing having Index lndZ_Min is positioned on the left of the right synthesis edge b^g (step 152). In the affirmative, 

55 this crossing is considered to be the left analysis edge bgg and left synthesis edge bgs (step 153). If instead the zero 
crossing having Index lndZ_Mln is still on the right of the right synthesis edge, then step 17 (Figure 11) of search 
continuation and conclusion is initiated. 

[0040] Search continuation and conclusion step 17 is represented in detail in Figure 17. After checking the need to 
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perform it (step 170), the zero crossings are reviewed again, in increasing index order. In the examination cycle (steps 
171 - 174 in Figure 17). a check is made at each step on whether the current zero crossing (indicated by Z_Tmp) is 
on the left of the right synthesis edge b^s distance from such edge is not lower than a predetermined minimum 
value 5. e.g. 10 signal samples (step 173). If the two conditions are not met, then the subsequent zero crossing is 
examined (step 174), otherwise this zero crossing is temporarily considered as the left synthesis and analysis edge 
(step 175) and the cycle is continued. The last zero crossing that meets condition 173 will be considered as the left 
synthesis and analysis edge (step 179). The check on r_P at step 176 is an additional means to distinguish between 
the case p^ < Pg and the case P3 > P3. and it causes steps 1 77 and 1 78 of the flow chart to be omitted In the case being 
examined. 

[0041] Figure 18 illustrates the search for and b^^ when the synthesis period is lengthened with respect to the 
analysis period. This search starts with a comparison between the lengthening in synthesis DifF_a_s and half the du- 
ration of the analysis period Pg (step 220). If Diff_a_s > Pa/2, step 24 (illustrated in detail in Figure 1 7) is started directly. 
If Diff_a_s < Pa/2, a backward search cycle is carried out, starting from the zero crossing preceding L2V. Distance 
Diff_z_a between the right analysis edge b^g and the current zero crossing ZCR(i) (steps 221 , 222) is calculated and 
is compared with DifF_a_s (step 223): if It is smaller, then the search cycle continues (step 224), othenA^ise the current 
zero crossing is considered as the left analysis and synthesis edge (step 225). If, at the end of the cycle, b^ and b^ 
have not been determined, then the phase of search continuation and conclusion is initiated (phase 24, Figure 12). 
[0042] If the lengthening required in synthesis Is less than or equal to half the analysis period, the operations de- 
scribed above allow finding a candidate, if any, that is the first for which the distance from the right analysis edge 
exceeds or is equal to the required lengthening. 

[0043] In the search continuation and conclusion phase, a backward search cycle is carried out. as stated, starting 
from the zero crossing preceding LZV, with the procedures Illustrated in steps 171 - 175 in Figure 17. Moreover, since 
a lengthening of the interval is considered (step 1 76), distance A_a between the right analysis edge b^a and the current 
zero crossing Z_Tmp, distance A_s between the right synthesis edge b^s and the current zero crossing Z_Tmp and 
ratio A between these distances are computed (step 1 77) for the zero crossings that meet the conditions of step 1 73. 
Ratio A is compared with twice the ratio between the periods (r_P*2) for the same reasons seen for comparison 146 
in Figure 15. and the zero crossing that meets the condition A ^ (r_P*2) will be taken as left analysis edge b^^ and left 
synthesis edge bgs. 

[0044] The conditions imposed in this phase allow assigning the task of left analysis edge to a zero crossing that 
lies on the left of the right synthesis edge, is as close as possible to it and also guarantees a sufficient time interval for 
the connecting function to be applied: in particular, given a certain analysis period, a left analysis edge positioned 
farther back in the original period will correspond to a greater lengthening required in synthesis. 
[0045] The method described herein can be performed by means of a conventional personal computer, workstation, 
or similar apparatus. 

[0046] It is evident that what is described above is given by way of non-limiting example and that variations and 
modifications are possible without departing from the scope of the invention as defined by the appended claims.. 

Claims 

1 . Method for speech signal synthesis by means of time concatenation of waveforms representing elementary speech 
signal units, in which: at least the waveforms associated to voiced sounds are subdivided into a plurality of inten/ats, 
corresponding to the responses of the vocal duct to a series of impulses of vocal cord excitation, synchronous with 
the fundamental frequency of the signal; the waveform in each interval is weighted; the signals resulting from the 
weighting are replaced with a replica thereof shifted In time by an amount depending on a prosodic information; 
and synthesis is performed by overiapping and adding the shifted signals; 
characterized in that: 

a current interval of original signal to be reproduced in synthesis is subdivided into an unchanging part, which 
lies between the interval beginning and a left analysis edge represented by a zero crossing of the original 
speech signal which meets predetermined conditions, and a variable part, which lies between the left analysis 
edge and a right analysis edge that essentially coincides with the end of the current interval, the left and right 
analysis edges being associated, in the synthesized signal, respectively with a left synthesis edge and a right 
synthesis edge, of which the former coincides with the left analysis edge, with reference to a start-of-intervat 
marker, and the latter coincides essentially with the end of the interval in the synthesized signal; 
a first connecting function is applied on the part of waveform on the right of the left analysis edge of the current 
interval of original signal, which function has a duration equal to that of the segment of synthesized waveform 
lying between the left and right synthesis edges and an amplitude that progressively decreases and is maxi- 
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mum in correspondence with the left analysis edge; 

a second connecting function is applied on the part of waveform on the left of the subsequent interval of original 
signal to be reproduced in synthesis, which function has a duration equal to that of the segment of synthesized 
waveform lying between the left and right synthesis edges and an amplitude that progressively increases and 
is maximum in correspondence with the beginning of said subsequent interval; 

each Interval of synthesized signal is built by reproducing unchanged the waveform in the unchanging part of 
the original interval and by joining thereto the wavefomn obtained by aligning in time and adding the two wave- 
forms resulting from applying the two connecting functions. 

Method according to claim 1 , characterized in that, if the duration of an interval is reduced or maintained unchanged 
for the synthesis with respect to the duration of the corresponding interval of the original signal, the left analysis 
edge and the left synthesis edge are determined with the following operations: 

computing the number of zero crossings of the original signal waveform and assigning each zero crossing an 
index, increasing from the beginning towards the end of the interval; 
checking that the number of zero crossings is not lower than a first threshold; 

searching, in case of positive outcome of the check, for a zero crossing candidate to act as left analysis and 
synthesis edge; 

backwards searching, among all zero crossings in the interval, except the last one, for a candidate that lies 
on the left of the right synthesis edge, is as close as possible to it and guarantees a time interval sufficient for 
the connecting functions to be applied, and assigning the task of left analysis and synthesis edge to this 
candidate. 

Method according to claim 2. characterized in that, in said computation of the zero crossings, zero crossings whose 
distance from the previous one is lower than a predetermined distance are not taken into consideration. 

Method according to claim 2 or 3, characterized in that, if the backwards search has yielded a negative result and 
if the number of zero crossings is higher than the first threshold, the tasks of left analysis edge and left synthesis 
edge are assigned to the zero crossing whose index corresponds to said threshold, if such a zero crossing lies on 
the left of the right synthesis edge. 

Method according to any of claims 2 to 4, characterized in that if the backwards search has yielded a negative 
result and if the number of zero crossings is not higher than the first threshold, a further search phase is carried 
out to identify the zero crossings lying on the left of the right synthesis edge and having a distance from the latter 
that is not lower than a second threshold, and the tasks of left analysis edge and left synthesis edge are assigned 
to the highest index zero crossing which meets these conditions. 

Method according to any of claims 2 to 5, characterized in that, if the comparison with the first threshold indicates 
that the number of zero crossings is lower than the first threshold, said backwards search is performed directly 
and, if it yields negative a result, said further search phase is performed directly. 

Method according to any of claims 1 to 6, characterized in that, if the duration of the interval is increased for the 
synthesis compared to the duration of the corresponding interval of the original signal, the left analysis edge and 
the left synthesis edge are determined with the following operations: 

computing the number of zero crossings of the original signal waveform; 
- comparing the duration lengthening of the synthesis inten^at and the duration of the original interval, to check 
that the lengthening does not exceed half the original interval duration; 

if the check yields a positive result, searching backwards, among all the zero crossings except the last one. 
for a candidate zero crossing that lies on the left of the right synthesis edge and is the first for which the 
distance from the right synthesis edge is not shorter than the lengthening of the interval duration, the tasks of 
left analysis edge and left synthesis edge being assigned to the zero crossing that meets said condition, if any. 

Method according to claim 7, characterized in that, in said computation of the zero crossings, the crossings whose 
distance from the previous crossing is lower than a predetermined distance are not taken into consideration. 

Method according to claim 7 or 8, characterized in that, if the interval duration lengthening exceeds half the original 
interval duration or if the backwards search is unsuccessful, a further backwards search phase is carried out to 
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identify the zero crossings tying on the left of the right synthesis edge and having a distance from the latter that is 
not lower than a third threshold; the distances from the right synthesis edge and from the right analysis edge and 
the ratio between these distances are computed for such zero crossings; said ratio is compared with the value of 
the ratio between the duration of the synthesis interval and the duration of the original interval, and the tasks of 
5 left analysis edge and left synthesis edge are assigned to the zero crossing whose index is the lowest among 

those for which the ratio between the distances from the edges does not exceed by more than a predetermined 
factor the ratio between durations. 



10 Patentanspriiche 

1. Verfahren zur Sprachsignalsynthese mit Hilfe einer Zeitverkettung von Signalverlaufen, die elementare Sprachsi- 
gnaleinheiten wiedergeben, wobei man: wenigstens diejenigen Signalverlaufe, die stimmhaften Lauten zugeordnet 
sind, in eine Vielzahl von Intervallen unterteitt, die den Reaktionen des Vokaltraktes auf eine Serie von Impulsen 

15 der Stimmbanderregung entsprechen, die synchron der Grundfrequenz des Signals slnd; den Signalverlauf in 

jedem Intervall gewichtet; die aus der Gewichtung resultierenden Signale ersetzt durch eine Replik derselben, die 
zeitlich um einen Betrag verschoben ist. der von einer prosodischen Infomiation abhangt; und die Synthese durch- 
fuhrt durch Oberlappen und Addieren der verschobenen Signale; dadurch gekennzeichnet, dad 

20 . man ein laufendes Intervall des in Synthese zu reproduzierenden ursprunglichen Signals in einen unveran- 

derllchen Tell und einen variablen Teil unterteitt, von denen der unveranderliche Teil zwischen dem Intervall- 
beginn und einem linken Analyserand liegt, welcher durch einen Nulldurchgang des ursprunglichen Sprach- 
signals gegeben ist, der vorgegebene Bedingungen erfutit, und der variable Teil zwischen dem linken Analy- 
serand und einem rechten Analyserand liegt, welcher im wesentllchen mit dem Ende des laufenden Intervalls 

25 ubereinstimmt, wobei der linke und der rechte Analyserand im synthetisierten Signal einem linken Synthe- 

serand bzw. einem rechten Syntheserand zugeordnet sind, von denen der linke Syntheserand mit dem linken 
Analyserand unter Bezugnahme auf eine Intervallstart-Markierung zusammenf^llt, und der rechte Synthe- 
serand im wesentlichen mit dem Ende des Intervalls im synthetisierten Signal zusammenfallt; 
man den Teil des Signalverlaufs auf der rechten Seite des linken Analyserands des laufenden Intervalls des 

^0 ursprunglichen Signals einer ersten Verbindungsfunktion untenA/irft, die eine Dauer gleich der des Abschnitts 

des synthetisierten Signalverlaufs hat, der zwischen dem linken Syntheserand und dem rechten Syntheserand 
liegt, und eine Amplitude hat, die fortschreitend abnimmt und in Ubereinstimmung mit dem linken Analyserand 
maximal ist; 

man den Teil des Signalverlaufe auf der linken Seite des nachfolgenden Intervalls des ursprQngtichen in Syn- 
35 these zu reproduzierenden Signals einer zweiten Verbindungsfunktion untenwirft, die eine Dauer gleich der 

des Abschnitts des synthetisierten Signalverlaufs hat, der zwischen dem linken Syntheserand und dem rechten 
Syntheserand liegt, und eine Amplitude hat, die fortschreitend zunimmt und in Obereinstimmung mit dem 
Beginn des nachfolgenden Intervalls maximal ist; 

man jedes Intervall des synthetisierten Signals aufbaut durch unveranderte Wiedergabe des Signalverlaufs 
^0 im unveranderlichen Teil des ursprunglichen Intervalls und durch daran Anhangen des Signalverlaufs. den 

man durch zeitliche Ausrichtung und Zusammenfugung der beiden von der Anwendung der zwei Verbindungs- 
funktion resultierenden Signalverlaufe, erhdit. 

2. Verfahren nach Anspruch 1 , dadurch gekennzeichnet, dafS man, sofem die Dauer eines Intervalls fOr die Synthese 
^5 im Hinblick auf die Dauer des entsprechenden Intervalls des ursprunglichen Signals vermindert Oder unverandert 

aufrechterhalten wird, den linken Analyserand und den linken Syntheserand mit den folgenden Operationen be- 
stimmt: 

man berechnet die Zahl der Nulldurchgange des ursprunglichen Signalverlaufs und ordnet jedem Nulldurch- 
50 gang einen Index zu, der vom Anfang zum Ende des Intervalls zu ansteigt; 

man uberzeugt sich, daf^ die Zahi der Nulldurchgdnge nicht niedriger als eine erste Schwelle ist; 

man sucht im Fall eines positiven Ergebnisses dieser Oberprufung nach einem Nulldurchgang-Kandidaten, 

der als linker Analyserand und Syntheserand dienen soli; 

man sucht unter alien Nulldurchgdngen des Inters/alls mit Ausnahme des letzten Nulldurchgangs ruckwarts 
55 nach einem Kandidaten, der links vom rechten Syntheserand liegt, diesem so nahe als moglich ist und eine 

fQr die anzuwendende Verbindungsfunktion ausreichende Zeitspanne sicherstellt, und weist die Aufgabe des 
linken Analyserands und Syntheserands diesem Kandidaten zu. 
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3. Verfahren nach Anspruch 2, dadurch gekennzeichnet, dad man bei dieser Berechnung der Nulldurchgange solche 
Nulldurchgdnge. deren Abstand vom vorhergehenden Nultdurchgang kleiner ist ats ein gegebener Abstand, auder 
Betracht mi 

5 4. Verfahren nach Anspruch 2 oder 3, dadurch gekennzeichnet, daft man, falls die RuckwSrtssuche ein negatives 
Ergebnis erbracht hat und die Zah! der NulldurchgMnge hGher ist als die erste Schwelle, die Aufgaben des (inken 
Analyserands und des linken Syntheserands demjenigen Nulldurchgang zuweist, dessen Index dieser Schwelle 
entspricht, sofem dieser Nulldurchgang links vom rechten Syntheserand liegt. 

10 5. Verfahren nach einem der Anspruche 2 bis 4, dadurch gekennzeichnet, dad man, falls die RuckwSrtssuche ein 
negatives Ergebnis erbracht hat und die Zahl der Nulldurchgange nicht hoher als die erste Schwelle ist, eine 
weitere Suchphase zum Identifizieren der NulldurchgSnge, die links vom rechten Syntheserand llegen und von 
diesem einen Abstand haben, der nicht niedriger als eine zweite Schwelle ist, durchfCihrt und die Aufgaben des 
linken Analyserands und des linken Syntheserands dem Nulldurchgang zuweist, der den hochsten Index hat, der 

15 diese Bedingungen erfQllt. 

6. Verfahren nach einem der Anspruche 2 bis 5, dadurch gekennzeichnet, da(^ man, falls der Verglelch mit der ersten 
Schwelle anzelgt, dad die Zahl der Nulldurchgange niedriger ist als die erste Schwelle. die RQckwSrtssuche direkt 
durchfuhrt und, wenn sie ein negatives Ergebnis erbringt, die weitere Suchphase direkt durchfuhrt. 

20 

7. Verfahren nach einem der AnsprUche 1 bis 6, dadurch gekennzeichnet, dali man, sofern die Dauer des Intervails 
fur die Synthese im Vergleich zur Dauer des entsprechenden Intervails des ursprunglichen Signals verlangert wird, 
den linken Analyserand und den linken Syntheserand mit den folgenden Operationen bestimmt: 

25 . man berechnet die Zahl der Nulldurchgange des ursprQngllchen Signalverlaufs; 

man vergleicht die Verlangerung der Zeitdauer des Syntheseintervalls mit der Zeitdauer des ursprunglichen 
Intervails zur OberprQfung, ob die VertSngerung nicht mehr ats die Halfte der ursprunglichen Intervalldauer 
ausmacht; 

sofern die Gberprufung ein positives Ergebnis gibt, sucht man unter alien Nulldurchgangen aufier dem letzten 
30 Nulldurchgang ruckwarts nach einem Nulldurchgang als Kandidaten, der links vom rechten Syntheserand liegt 

und der erste Ist, fQr den der Abstand vom rechten Syntheserand nicht kQrzer als die Verldngerung der Dauer 
des Intervails ist, und weist man die Aufgaben des linken Analyserands und des linken Syntheserands dem- 
jenigen Nulldurchgang zu, der diese Bedingung erfullt, sofem ein solcher existiert. 

35 8. Verfahren nach Anspruch 7, dadurch gekennzeichnet, dad man bei der Berechnung der Nulldurchgange diejenigen 
Nulldurchgange, deren Abstand vom vorhergehenden Nulldurchgang kleiner ist als ein gegebener Abstand, nicht 
in Betracht zieht. 

9. Verfahren nach Anspruch 7 oder 8, dadurch gekennzeichnet, daft man, sofern die Verlangerung der Intervalldauer 
40 mehr als die Halfte der Dauer des ursprunglichen Intervails ausmacht oder sofem die Ruckwartssuche erfolglos 

ist, eine weitere Ruckwdrtssuchphase durchfQhrt, um die Nulldurchgange zu identifizieren. die links vom rechten 
Syntheserand liegen und von diesem einen Abstand haben, der nicht kleiner als eine dritte Schwelle ist; da(^ man 
die Abstande vom rechten Syntheserand und vom rechten Analyserand und das Verhaltnis zwischen diesen Ab- 
stdnden fQr diese Nulldurchgange berechnet; dail man dieses Verhaltnis mit dem Wert des Verhaltnisses zwischen 
45 der Dauer des Syntheseintervalls und der Dauer des ursprunglichen Intervails vergleicht und die Aufgaben des 

linken Analyserands und des linken Syntheserands demjenigen Nulldurchgang zuweist, dessen Index der nied- 
rigste unter denjenigen ist, fQr die das Verhditnis der Abstande von den Randern das Verhaltnis zwischen den 
Zeitdauem nicht um mehr als einen gegebenen Faktor ubersteigt. 

50 

Revendications 

1 . Proc6d6 de synthase de signaux de parole par concatenation dans le temps de fonnes d'onde repr^sentant des 
unites ei^mentaires du signal de parole, oCi: on divise au moins les fomnes d*onde associSes aux sons vois^s en 
55 une plurality d'intervalles, qui correspondent aux r^ponses du conduit vocal d une s6rie d'impulsions d'excitation 

des cordes vocales synchrones avec la frequence fondamentale du signal; on soumet la forme d'onde comprise 
dans chaque intervene d une pond^ration; on remptace les signaux resultant de la pond^ration par une r^plique 
d^cal^e dans le temps d'une quantity dependant d'une Infomiation prosodique; et on effectue la synthase au 
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moyen du recouvrement et de la somme des signaux d^cal^s, caract^ris6 en ce que: 

on divise un intervalle courant du signal original devant etre reproduit en synthase en une partie invariable, 
comprise entre le d6but de Tintervalle et un bord gauche d'analyse, repr^sent6 par un passage par le z^ro du 
signal de parole original satisfaisant des conditions pr^^tablies, et une partie variable, comprise entre le bord 
gauche d'analyse et un bord droit d'analyse qui coincide essentieliement avec la fin de I'intervalle courant, le 
bord gauche et le bord droit d'analyse 6tant associ6s, dans le signal synth6tis6, respectivement d un bord 
gauche de synthase et d un bord droit de synthase, dont le premier coincide avec le bord gauche d'analyse, 
avec r^f^rence d un marqueur de d6but d'intervalle, et le deuxi^me coincide essentieliement avec la fin de 
rintervalle dans le signal synth6tls6. 
- on applique, sur la partie de fomie d'onde d droite du bord gauche d*analyse de I'intervalle courant du signal 
original, une premiere fonction de raccordement. qui a une dur^e 6gale d celle du segment de forme d'onde 
synth^tis^e compris entre le bord gauche et te bord droit de synthase et une amplitude progressivement d^- 
croissante et maximale en correspondence du bord gauche d'analyse; 

on applique, sur la partie de forme d'onde ^ gauche de I'intervalle imm^diatement successif du signal original 
d reproduire en synthase, une deuxi^me fonction de raccordement, qui a une dur6e 6gale d celle du segment 
de forme d'onde synth^tis^e compris entre le bord gauche et le bord droit de synthase et une amplitude 
progressivement croissante et maximale en correspondence du ddbut dudit intervalle successif; 
on construit cheque intervalle de signal synth6tis6 en reproduisant inchang6e la forme d'onde comprise dans 
la partie invariable de I'intervalle original, ^ laquelle est unie la forme d'onde obtenue en alignant dans le temps 
et en additionnant les deux formes d'onde resultant de I'application des deux fonctions de raccordement. 

Proc6d6 selon la revendication I, caract^ris^ en ce que, dans le cas ou la dur6e d'un intervalle est r^duite ou 
maintenue inchang^e pour la synthase par rapport d la dur6e de I'intervalle con^spondant du signal original, le 
bord gauche d'analyse et le bord gauche de synthase sont d^temninSs avec les operations suivantes: 

calcul du nombre de passages par le z6ro de la forme d'onde du signal original et affectation, d cheque passage 

par le z6ro, d'un indice croissant du d^but vers la fin de I'intervalle; 

verification que le nombre de passages par le z6ro n'est pas inf6rieur d un premier seuil; 

recherche, si ladite verification donne un resultat positif, d'un passage par le zero candidat pour servir de bord 

gauche d'analyse et de synthase; 

recherche d rebours, parmi tous les passages par le z6ro de I'intervalle ^ Texclusion du dernier, d'un candidat 
se trouvant a gauche du bord droit de synthese, et pour autant que possible proche de celui-cl et garantissant 
un Intervalle temporel suffisant pour I'application des fonctions de raccordement, et attribution du role de bord 
gauche d'analyse et de synthase ^ ce candidat. 

Precede selon la revendication 2, caracterise en ce que dans ledit calcul des passages par le zero, on ne considere 
pas les passages ayant une distance du passage precedent inferieure e une distance prefixee. 

Precede selon la revendication 2 ou 3, caracterise en ce que, si la recherche e rebours a donne un resultat negatif 
et si le nombre de passages par le zero est superieur au premier seuil, on attribue le rdle de bord gauche d'analyse 
et de bord gauche de synthese au passage par le zero dont I'indice correspond ^ ce seuil, si ce passage par zero 
se trouve e gauche du bord droit de synthese. 

Precede selon Tune quelconque des revendications 2^4, caracterise en ce que, si la recherche ^ rebours a donne 
un resultat negatif et si le nombre de passages par le zero n'est pas superieur au premier seuil. une phase de 
recherche ulterieure est effectuee pour Identifier les passages par le zero places e gauche du bord droit de synthese 
et ayant une distance de ce dernier non inferieure e un second seuil, et on attribue le role de bord gauche d'analyse 
et de bord gauche de synthese au passage par le zero avec Tindice le plus eieve qui satisfait ces conditions. 

Precede selon I'une quelconque des revendications 2 d 5, caracterise en ce que, si la comparaison au premier 
seuil indique que le nombre de passages par le zero est inferieur audit premier seuil, on effectue directement ladite 
recherche e rebours, et si cette derniere donne un resultat negatif. on effectue directement ladite phase de re- 
cherche ulterieure. 

Precede selon I'une quelconque des revendications I e 6, caracterise en ce que, au cas ou la duree de I'intervalle 
est prolongee pour la synthese par rapport d la duree de I'intervalle correspondent du signal original, le bord gauche 
d'analyse et le bord gauche de synthese sont determines par les operations suivantes: 
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calcul du nombre de passages par le z6ro de ta forme d'onde du signal original; 

comparaison entre Tallongement de la dur6e de I'intervalle pour ta synthase et la dur^e de Tintervalle original, 
pour verifier que rallongement ne depasse pas la moitie de la dur^e de rintervalle original; 
en cas de r6sultat positif de la verification, recherche d rebours, parmi tous les passages par le z^ro d Tex- 
elusion du dernier, d*un passage par le z6ro candidat qui se trouve d gauche du bord droit de synthase et qui 
soit le premier dont la distance du bord droit de synthase n*est pas inf^rieure d rallongement de la dur^e de 
I'intervalle, le role de bord gauche d'analyse et de bord gauche de synthase 6tant attribu^s d r^ventuel passage 
par le z6ro qui satisfait cette condition. 

Proced^ selon la revendication 7 caract^ris^ en ce que, dans ledit calcul des passages par le z6ro, on ne prend 
pas en consideration les passages ayant une distance du passage precedent Inf^rieure d une distance pr66tablie. 

Proc6d6 selon la revendication 7 ou 8 caract^ris^ en ce que si le prolongement de la dur6e de I'intervalle depasse 
la moitie de la dur^e de rintervalle original ou si la recherche d rebours ne donne aucun r6sultat, on effectue une 
phase ult6rieure de recherche d rebours pour identifier les passages par le z6ro places d gauche du bord droit de 
synthese et ayant une distance de celui-ci non inf^rieure d un troisieme seuil; pour ces passages par le z^ro, on 
calcule les distances du bord droit de synthase et du bord droit d'analyse et le rapport entre ces distances; on 
compare ce rapport avec la valeur du rapport entre la dur^e de rintervalle en synthase et la dur^e de I'intervalle 
original et on attribue le rdle de bord gauche d'analyse et de bord gauche de synthase au passage par le z6ro 
pr^sentant I'indice le plus bas parmi ceux pour lesquels le rapport entre les distances des bords ne depasse pas, 
d'un facteur pr^^tabli, le rapport entre les dur^es. 
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